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CLAIMS 

What is claimed is: 

1 . A method for providing captioning in an AV signal, the method 
comprising: 

converting an audio signal in the AV signal to caption data 
automatically; and 

associating the caption data with the AV signal at a time 
substantially corresponding to a video signal associated with the converted audio 
signal in the AV signal. 

2. The method as set forth in claim 1 further comprising: 
capturing the AV signal, the AV signal comprising the audio signal 

and the video signal; and 

providing the audio signal in the AV signal for the converting. 

3. The method as set forth in claim 1 wherein the converting further 
comprises: 

determining a first amount of data in the caption data; and 
providing the caption data for the associating when the first amount 
is greater than a threshold amount or when a first period of time has expired. 

4. The method as set forth in claim 1 wherein the associating further 
comprises synchronizing the caption data with one or more cues in the AV signal. 

5. The method as set forth in claim 1 wherein the associating further 
comprises embedding the caption data within the AV signal. 

6. The method as set forth in claim 1 further comprising displaying at 
least the video signal and the associated caption data. 
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7. The method as set forth in claim 1 further comprising storing on at 
least one recordable medium at least the video signal and the associated caption 
data. 



8. The method as set forth in claim 1 wherein the converting further 
comprises translating at least one word in a first language of the audio signal into 
a second language, the at least one translated word included in the caption data. 

9. A speech signal processing system, the system comprising: 

a speech-to-text processing system that converts an audio signal in 
an AV signal to caption data; and 

a signal combination processing system that associates the caption 
data with the AV signal at a time substantially corresponding to a video signal 
associated with the converted audio signal in the AV signal. 

10. The system as set forth in claim 9 further comprising a source for 
providing the audio signal in the AV signal to the speech-to-text processing 
system. 



1 1 . The system as set forth in claim 9 wherein the speech-to-text 
processing system further comprises a counter that determines a first amount of 
data in the caption data and a timer that determines when a first period of time has 
expired, wherein the speech-to-text processing system providing the caption data 
for the associating when the first amount is greater than a threshold amount or 
when timer indicates that the first period of time has expired. 

12. The system as set forth in claim 9 wherein the signal combination 
processing system synchronizes the caption data with one or more cues in the AV 
signal. 



13. The system as set forth in claim 9 wherein the signal combination 
processing system embeds the caption data within the AV signal. 
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14. The system as set forth in claim 9 further comprising a video 
monitor for displaying at least the video signal and the associated caption data. 

15. The system as set forth in claim 9 further comprising a translator 
5 that translates at least one word in a first language of the audio signal into a 

second language, the at least one translated word included in the caption data, the 
translating device coupled to the speech recognition processor. 

16. The system as set forth in claim 9 wherein the signal separation 
1 0 processing system, the speech-to-text processing system and the signal 

combination processing system are integrated within a device, the device being 
portable and usable in a classroom environment.. 

17. A computer readable medium having stored thereon instructions 
1 5 for providing captioning which when executed by at least one processor, causes 

the processor to perform steps comprising: 

converting an audio signal in an AV signal to caption data 
automatically; and 

associating the caption data with the AV signal at a time 
20 substantially corresponding to a video signal associated with the converted audio 
signal in the AV signal. 

1 8. The medium as set forth in claim 1 7 further comprising: 
capturing the AV signal, the AV signal comprising the audio signal 

25 and the video signal; and 

providing the audio signal in the AV signal for the converting. 

19. The medium as set forth in claim 17 wherein the converting further 
comprises: 

30 determining a first amount of data in the caption data; and 

providing the caption data for the associating when the first amount 
is greater than a threshold amount or when a first period of time has expired. 
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20. The medium as set forth in claim 17 wherein the associating further 
comprises synchronizing the caption data with one or more cues in the AV signal. 

2 1 . The medium as set forth in claim 1 7 wherein the associating further 
5 comprises embedding the caption data within the AV signal. 

22. The medium as set forth in claim 17 further comprising displaying 
at least the video signal and the associated caption data. 

10 23. The medium as set forth in claim 1 7 further comprising storing on 

at least one recordable medium at least the video signal and the associated caption 
data. 

24. The medium as set forth in claim 17 wherein the converting further 
15 comprises translating at least one word in a first language of the audio signal into 
a second language, the at least one translated word included in the caption data. 



